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Abstract. We prove that if an ergodic action of a countable group on a 
probability space admits a generating partition having finite Shannon entropy 
then it admits a finite generating partition. 



1. Introduction 

Let G be a countable group acting by measure preserving bijections on a proba- 
bility space (X, fj,). For a partition a of X, we denote by G-a the smallest cr-algebra 
containing the sets g ■ A for g € G and A £ a. The partition a is generating (or 
a generator) if for every measurable set B C X there is some B' £ G-a with 
fi(BAB') = 0. The Shannon entropy of a partition a is 

H («)= E -KA)-log(KA)). 
if there is a countable subcollection a* C a with /i(Ua*) = 1, and otherwise H(a) = 

CO. 

A classical theorem of ergodic theory is Krieger's finite generator theorem [10j . 
This theorem states that if k is an integer and Z rx (X, /i) is an ergodic action with 
Kolmogorov-Sinai entropy less than log(fc), then the action Z rv (X,n) admits a 
finite generating partition of size k. Less known is a similar but earlier result of 
Rohlin [13] . Rohlin proved that for any essentially free action Z rv (X, fi) , the 
Kolmogorov-Sinai entropy of this action is equal to the infimum of the Shannon 
entropies of the generating partitions. A result stronger than both Rohlin's theorem 
and Krieger's theorem was obtained by Denker in [5]. 

Krieger's finite generator theorem extends to essentially free ergodic actions of 
general countable amenable groups. This more general version of Krieger's theorem 
was stated by Sujan in [17] and proved by Danilenko and Park in [4 with the more 
restrictive requirement that the Kolmogorov-Sinai entropy be less than log(fc — 1) 
(Rosenthal [TJ] proved this using log(fc — 2) and Thouvenot [IB] proved this for 
actions of Z™ using log(fc — 2)). The extension of Rohlin's theorem to essentially 
free actions of amenable groups is not in the literature, but it follows from the 
techniques of Danilenko and Park in [4.. So in the setting of actions of amenable 
groups, the behavior of generating partitions is well understood. 

Entropy theory recently has been extended beyond the realm of actions of 
amenable groups. In 2008, Lewis Bowen defined (f-invariant) entropy for actions 
of finitely generated free groups [T] and (sofic) entropy for actions of sofic groups 
[2]. The definition of sofic entropy was later expanded by Kerr-Li [8] (see also [7]). 
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Sofic entropy and f-invariant entropy have strong similarities with Kolmogorov- 
Sinai entropy, and in fact when the acting group is amenable these entropies agree 
with Kolmogorov-Sinai entropy. Furthermore, f-invariant entropy is essentially a 
special case of sofic entropy. The theories of sofic entropy and f-invariant entropy, 
being quite new, are currently poorly understood. In particular, it is not clear 
what relationships sofic entropy and f-invariant entropy have with generating par- 
titions. As with Kolmogorov-Sinai entropy, sofic entropy and f-invariant entropy 
are easier to use, define, and compute when there are generating partitions with 
finite Shannon entropy (in fact, the definition of f-invariant entropy still requires a 
generating partition having finite Shannon entropy). So theorems along the lines of 
Krieger's theorem and Rohlin's theorem mentioned above would certainly benefit 
the theories of sofic entropy and f-invariant entropy. Thus the question arises as 
to what can be said about generating partitions outside of the realm of actions of 
amenable groups. 

Although we draw motivation from sofic entropy and f-invariant entropy (which 
deal with actions of sofic groups and finitely generated free groups, respectively), 
our main theorem deals with actions of general countable groups. We prove the 
following finite generator theorem. 

Theorem 1.1. Let G be a countable group acting ergodically by measure preserving 
bijections on a standard probability space (X,fi). If this action admits a generating 
partition having finite Shannon entropy, then it admits a finite generating partition. 

We mention that although our proof is constructive, it does not immediately 
imply any relationship between the Shannon entropy of the original partition and 
the size of the finite partition constructed. 

We obtained the above theorem while trying to establish a Kriegcr finite gen- 
erator theorem for f-invariant entropy. However, we found that Krieger's theorem 
and Rohlin's theorem fail in this setting. 

For an action G rx (X,fi) we let Ag(J,/i) denote the infimum of the Shannon 
entropies of the generating partitions (this is +00 if there are no such partitions) 
and we let A G (X, /z) denote the smallest size of a finite generating partition (again 
this is +00 if there are no such partitions). If G is a finitely generated free group 
then we denote the f-invariant entropy of the action G rx (X, 11) by fo(X, /j,). We 
remark that fc{X,fj) is only defined when there is a generating partition having 
finite Shannon entropy. When Jg(X, fi) is defined it takes values in K U {—00}. 

Proposition 1.2. Let G be a finitely generated non-cyclic free group. For every 

heR, 

sup A g (X,ij,)= sup A G (X,n) = +00, 

Gr\(X,fi) Gr^(X^) 

where the supremums are taken over all essentially free ergodic probability measure 
preserving actions G rx (X,fi) with fa(X,fi) defined and fa(X,n) = h. 

Since f-invariant entropy is currently only defined when there is a generating 
partition having finite Shannon entropy, it follows from our main theorem that 
A G (X, fj) and Ag(1, /i) are finite for any ergodic action G rx (X,n) in which 
fc(X,fi) is defined (so in particular for the actions considered in the proposition 
above) . 

We wish to emphasize that this proposition only says that the most obvious 
translations of Krieger's theorem and Rohlin's theorem to the setting of f-invariant 
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entropy are false. There is still opportunity for subtle modifications of Krieger's 
theorem and Rohlin's theorem to be true for f-invariant entropy (we will mention 
such a possible modification). 

We obtain a similar but much weaker result for sofic entropy. With sofic entropy 
the situation is much different though because the sofic entropy of a sofic group 
action G rx (X, /i) is not a single number but a collection of numbers. These 
numbers are indexed by sofic approximation sequences to the group. It is known 
that different sofic approximation sequences can give different sofic entropy values, 
however it is not yet understood how widespread this phenomena is. For a sofic 
group G, a sofic approximation sequence E to G, and an action G rx (X,fi), we 
denote the corresponding sofic entropy by ft,g(X, /i). We remark that h^k(X : /i) is 
always defined and takes values in {— 00} U [0, +00]. 

Proposition 1.3. There exists a sofic group G, a sofic approximation sequence E 
to G, and an essentially free ergodic action G rx (X,/i) such that h^,{X,n) = —00 
but A* G {X, fx) = A G (X, n) = +00. 

We do not view the above corollary as sufficient grounds to say that Krieger's 
theorem and Rohlin's theorem fail for sofic entropy. The fact is that having 
h^(X,fi) — — 00 reflects almost nothing about the action; it only means that E 
is inadequate for modeling the action G rx (X, fj) . We do not know if Rohlin's 
theorem and Krieger's theorem hold for actions whose sofic entropy is not negative 
infinity. 

Organization. In Section [2] below, we prove Theorem lf.il Then in Section [3] we 
prove Propositions 11.21 and 11.31 These two sections are written independently of 
one another. 

Acknowledgments. This material is based upon work supported by the National 
Science Foundation Graduate Student Research Fellowship under Grant No. DGE 
0718128. The author would like to thank his advisor, Ralf Spatzier, for helpful con- 
versations. The author would also like to thank Benjamin Weiss for some references 
and for information on Rohlin's theorem. 

2. Construction of finite generators 

We begin with an equivalent characterization of generating partitions. For a 
partition a of X and a point x G X, we write a(x) to denote the unique member 
Ae a with x e A. 

Lemma 2.1. Let X be a standard Borel space, let li be a Borel probability measure 
on X , and let G be a countable group acting by measure preserving bijections on 
X . The following are equivalent for a countable measurable partition a of X 

(i) a is a generating partition; 

(ii) for every Borel set B C X there is a set B' G G • a with fi(BAB') = 0; 

(iii) there is X' C X such that /J-(X') = 1 and for all x 7^ y G X' there is g G G 
with a(g ■ x) ^ a(g ■ y). 

Proof. The equivalence of (i) and (ii) is by definition. 

(ii) => (iii). Since X is a standard Borel space, there is a countable collection 
(S n )„ e N of Borel subsets of X such that the tr-algebra generated by {B n : n G N} 
is precisely the collection of all Borel subsets of X and such that (B n ) ne ^ separates 
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points, meaning that for x ^ y G X there is n G N with either x € B n and y g" B n 
or x B n and y G B n [6l Proposition 12.1]. For each n G N let G„ G G ■ a be such 
that n(B n AC n ) = 0. Set 

X' = X \ |J (S„AC„). 

Then /x(X') = 1. Now fix y G X' with x ^ y. Then there is n G N with £?„ 
containing either x or y but not containing both. Since x,y E X' we have a; G B n 
if and only if x G G„, and similarly y G -B„ if and only if y G G„. Therefore C n 
contains either x or y, but it does not contain both. Since C n lies in the c-algebra 
generated by the sets {g ■ A : g G G, A G a}, there must be g G G and A & a with 
g • A containing either x or y but not both. Then a{g~ l ■ x) ^ ot{g~ l ■ y). 

(iii) => (ii). Let X 1 Q X be such that ^i(X') = 1 and for all x ^ y € X' there 
is g G G with a(<? • x) 7^ a(g • y). By replacing X' with H^gS ' ^ necessary, 
we may suppose that g ■ X' = X' for every g G G. Let /3 be the partition of X' 
induced by a. Since \ X 1 ) = 0, it suffices to show that for every Borel set 
B G X we have -B n X' G G • /3. Consider the space /3 G of all functions from G to 
p. We give /3 G the topology of point-wise convergence (under the discrete topology 
on p). Then f3 G is a Polish space since f3 is countable. We let G act on /3 by 
the rule {h ■ z)(g) = z(h~ 1 g) for h,g G G and z G /? G . Define : X' ->■ /3 G by 
(^(ar)^) = ^(.g- 1 • x). Notice that 

4>{h ■ x)(g) = p{g~ l h ■ x) = cj>{x){h- l g) = [h ■ cj>(x)}(g). 

So 4>{h ■ x) — h ■ 4>{x). If x =/= y E X' then by assumption there is g G G with 
/?(<? • x) 7^ /3(g • y) and thus </>(a;) ^ </>(y)- So is injective. The function 4> is 
Borel since the inverse image of any open set in p is Borel. Consider the partition 
£ = {C A ■ A G P} of P G , where C A = {z E P G : z{l G ) = A}. It is readily 
seen that the G-translates of the members of £ generate the open subsets of P G . 
Therefore G ■ £ is precisely the collection of Borel subsets of p . Notice that 
A C <j>- l {C A ) for A G /3 and thus A = ^ _1 (Ga) for A G /3 (since and 
are both partitions of X'). Consider the collection C of subsets G G p G such that 
(/> _1 (C) E G ■ p. Clearly C is a cr-algebra and g ■ Ca G C for every <? G G and 
Ga G £. Thus _1 (G) G G • p for every Borel set G C /3 G . Now consider a Borel 
set .B G X. Since </> is injective and Borel, (f>(B n X') is a Borel subset of P G [51 
Corollary 15.2]. Therefore BOX' = ^ (<t>(B n X')) E G ■ p. So there is B'eG-a 
with B' C\X' = BC\X' and thus fi(BAB') = since \ X') =0. □ 

For a finite set S* we let S <u; denote the set of all finite words with letters in S 
(the oj in the superscript denotes the first infinite ordinal). For z G S <ul we let \z\ 
denote the length of the word z. In the first step of the proof of [10l Theorem 2.1], 
Krieger proves the following. 

Lemma 2.2 (Krieger). Let (X,/i) be a probability space. If a is a countable measur- 
able partition of X with H(a) < 00 then there exists an injection L : a — » {1, 2, 3} <tJ 
such that 

^|L(A)|. M ( J 4)<co. 

Aea 

As a convenience to the reader, we include the proof below. 
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Proof. This is clear if a is finite. So suppose that a is countably infinite and 
enumerate a as a — {Ai, A2, ■ . .}, where /i(A m +i) < /i(i m ) for all m. For m > 1 
choose £(m) G N so that - \og(fi(A m )) - 1 < £(m) < -log(/z(^4 m )). Then 

g-t(m) < e -t(m) < e log(p(A m )) + l = e . M(Am) _ 

Thus Sm=i 3~*( m ) < e. Notice that the sequence (i(m))$^ =1 is non-decreasing. Set 
A^i = 1 and for m > 1 define 

N rn = min{fc > iV m _! : > t(N m -i)}. 

Then 

OO OO 

£ (N m+1 - N m ) ■ 3"*^ = £ 3-*^ < e. 

m—1 m—1 

So there is too > 1 such that N m+ i — N m < 3'^™' for all m > too. There- 
fore it is possible to choose L(A m ) e {l^,^} 1 ^ for every to > ttiq so that 
L : {A mo , A mo+ i, . , .} — » {1,2,3} <W is injective. Moreover, since the inequality 
-^m+i — N m < 3^ NmS> (which holds for m > mo) is strict, L can be extended to an 
injective function L : a — > {1, 2, 3} <w . Finally, it suffices to show that 

00 

\L(A m ) \ ■ 11(A) < 00. 

m—rriQ 

This follows from the fact that |L(A m )| — t(m) < — log(fj r (A m )) for m > tjiq and 

Em=m " l0g(M^m)) ' K^m) < H(«) < OO. □ 

The function L above can be extended to X by setting L(x) — L(a(x)). The 
above lemma then says that the labeling L : X — >• {1, 2, 3} <w has finite length on 
average. The idea behind the proof of Theorem 11.11 is to rearrange the L "data" 
within each orbit to obtain a new function (a relabeling) R : X — > {1,2,3,4} <W 
which has uniformly bounded length. The function R would then have finite image 
and thus induce a finite partition of X. In order for this partition to be generating, 
one must ensure that the function L can be recovered from R. In |10j . Krieger 
carried out this argument in the case of Z actions, obtaining a weak form of his 
finite generator theorem which did not specify the smallest possible size of a finite 
generator. While our proof is inspired by his argument, our proof is quite distinct 
as Krieger's argument relied heavily on properties of Z. 

The following lemma is essential for the task of rearranging the L data within 
each orbit. 

If G acts on (X,/j,) and iCI, then we say that x,y G X are A-symmetric if 
for every g^Gg-x^Ao-g-yEA. 

Lemma 2.3. Let G be a countable group acting ergodically by measure preserving 
bijections on a probability space (X, fx). For every pair of measurable sets A, B C X 
there exist measurable sets P\(A, B), P2(A, B) C X and a measurable bijection 
tj}(A,B) : Pi(A,B) ->• P 2 (A,B) satisfying the following: 

(i) Pi(A,B) C A and P 2 {A 1 B) C B; 

(ii) either fi{A\Pi(A,B)) =0 or n{B\P 2 {A,B)) = 0; 

(iii) if x,y S X are both A-symmetric and B-symmetric, then x and y are both 
Pi (A, B)- symmetric and P 2 (A, B) -symmetric; 

(iv) ip(A, B)(x) S G ■ x for every x e Pi (A, B); 
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(v) if x,y G Pi(A,B) are both A- symmetric and B-symmetric, then there is 
h e G with i/)(A, B)(x) = h ■ x and ip(A, B)(y) = h-y. 

Proof. We first define auxiliary functions Qi, Q 2 , and 8 which will play roles similar 
to Pi, P2, and ip, respectively. The idea is to define Qi, Q 2 , and 9 to achieve clauses 
(i), (hi), (iv), and (v) and then use these functions repeatedly to perform a type of 
exhaustion argument and achieve clause (ii). 

Fix any well ordering, <, of G. If A, B C X are measurable and (G ■ A) fl B = 
then we set Qi(A, B) = Q 2 (A, B) = 9(A, B) = 0. If (G ■ A) n B ^ then we let 
h G G be the ^-least element of G satisfying (h ■ A) fl B ^ 0. In this case we set 

Qi(A,B) =ADh- 1 -B 

Q 2 {A,B) = (h- A)C\B 

9(A, B)(x) = h ■ x (for x G Qi(A, B)). 

Notice that Qi(A, B) and Q 2 (A, B) are measurable subsets of X and 9(A, B) is a 
measurable function. If Pi, P 2 , and ip are replaced with Qi, Q 2 , and 9, respectively, 
then clauses (i), (iv), and (v) are clearly satisfied (clause (v) immediately follows 
from the simple definition of 6 (A, B)). Clause (hi) is also satisfied, for if we assume 
Qi(A, B) and Q 2 (A,B) are non-empty (clause (hi) is trivial otherwise) and let h 
be as above, then for any x G X and g G G we have g ■ x G <3i(A B) ^ (g ■ x € 
A A hg ■ x e B) and 5 • x G Q2(A B) (g ■ x £ B A h~ l g ■ x E A). 

We have Qi(A, P) C A and Q2(A P) Q B. By repeatedly using the functions 
Qi and Q2 we seek to exhaust (in measure) either A or P. We recursively define 

P z 1 (A,B) = Q i (A,B), 
P z n (A, B) =Qi(A\ PI 1 ' 1 (A, B),B\ P r 2 L -\A, B)) U P^iA P), 
r(A, B) = 6{A \ PT\A, P), P \ P 2 "" \A, P)). 
We set Pi(A, B) = [j n ^ Pp (A, B) and ij(A,B) ={} n ^ n {A,B). Clearly p (A, P) 
is a measurable subset of X and P) is a measurable function. We remark that 
ip(A, B) is a well defined function since the domains of the ip n, s are pairwise disjoint. 
Clauses (i) and (iv) are clearly satisfied. We now check clauses (ii), (hi), and (v). 
(ii). Let hi be the ^-least element of G with (hi ■ A) fl P 7^ and for n > 1 let 
/i„ be the ^-least element of G with 

(/*„ • (A \ pr\A, P))) n (P \ P 2 "" '(A B)) + 0. 

If for some n no such ft,„ exists then by ergodicity either n(A \ P 1 ra_1 (A,P)) = 
or /i(P \ P 2 n ^ 1 (A,B)) = and thus clause (ii) is satisfied since P^ 1 (A,B) C 
Pi(A, B). So we may suppose the /i„'s are defined. We must have h n -< h n+ i since 
P" _1 (A P) C P"(A, P). So if 5 G G is fixed then 

( ff • (a \ pr\A, p))) n (p \ pr 1 ^, s)) = 

for all but finitely many n > 1. Thus 

(S • (A \ Pi (A, P))) n (P \ P 2 (A, B)) = 

for every g G G. By ergodicity it follows that either /x(A \ Pi (A, P)) = or 
»(B\P 2 (A,B))=0. 

(hi). Fix x,y <E X which are both A-symmetric and P-symmetric. Then for 
i = 1, 2 we have that x and y are P}{A, P)-symmetric, since P}{A, B) = Qi(A, B). 
Now suppose that x and y are P™ _1 (A, P)-symmetric for i = 1,2. Then x and y 
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are (A \ P" _1 (A, P))-symmetric and (P \ P^ _1 (A, P))-symmetric. It follows from 
the definition of P" and the properties of Qi that x and y are P™ (A, B) symmetric 
for i = 1,2. By induction, this holds for all n > 1. Thus cc and y are Pi(A, B)- 
symmetric for i = 1,2. 

(v). Fix x,y G Pi(A, P) which are both A-symmetric and P-symmetric. Let 
n > 1 be such that x lies in the domain of ip n (A,B). Notice that the domain 
of ip n (A,B) is Pi (A, B) \ P'^ 1 (A, B). The argument in the previous paragraph 
shows that x and y are P± ( A, P)-symmetric for every k > 1. Therefore y lies in 
the domain of ip n (A,B) as well. So 

x, y e P?(A, B) \ Pr\A, B) = Q 1 (A \ If- 1 (A, B), B \ J?" 1 (A, B)) 

and x and y are both (A\P^~ 1 (A, P))-symmetric and (P\P 2 ™" 1 (A, P))-symmetric, 
so from the properties of Qi, Q2, and 9, it follows that there is h £ G with 

1>(A, B)(x) = r(A, B)(x) = 9(A \ Pf" 1 ^, B),B \ P^iA, B)){x) =h-x 

and 

1>(A, B)(y) = r(A B){y) = 6{A \ ^{A, P), P \ P«- 1 {A, B)){y) =h-y. 

This completes the proof. □ 

We are now ready to prove the main theorem. 

Theorem 2.4. Let G be a countable group acting ergodically by measure preserving 
bijections on a standard probability space (X,/i). If this action admits a generating 
partition having finite Shannon entropy, then it admits a finite generating partition. 

Proof. Let a be a generating partition with H(a) < 00. By combining the classes 
of a having measure into a single class, we may suppose that a is countable. By 
Lemma |2~21 there is an injective function L : a -> {1, 2, 3} <w satisfying 

J2\L(A)\-v(A)<w. 

Ago 

For x £ X define L(x) = L(a(x)). 

The function L : X — > {1, 2, 3} <LJ on average has finite length, so the idea now 
is to rearrange the L-data within each orbit so that in the end every point of X 
has a word of uniformly finite length associated to it. In doing this, one must 
take care not to lose data, and more importantly one must rearrange the data in 
such a way that the original function L can be decoded from the new data. The 
functions appearing in the previous lemma play the critical role of achieving these 
requirements. 

First we need to determine how long the new words we create should be. Since 
is integer valued, we have 

n ■ K{x G X : \L(x)\ = n}) = ]T \L(A)\ ■ < 00. 

n>i Aea 

So there is C > 1 such that 

n-fi({xeX : \L(x)\=n}) < J. 

n>C 

After rearranging the L-data, the new words we construct will have length bounded 
above by C + 2. 
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We now use the previous lemma to determine how to rearrange the L-data. 
For n > 1 define B n = {x G X : \L(x)\ > C + n}. Then B n+ i C B n . Since 
L(x)| — C = \{n > 1 : x G B n }\ when |i(x)| > G, we have 

l*(Bi) < ]T v{B n ) = J2 n ■ M{* e X ■ \ L (x)\ = C + n}) < 1 

n>l n>l 

Set Ti = P 2 (B 1 ,X \ B t ) and 6 X = ip(B t ,X \ B{). In general, for n > 1 define 
T n = P 2 (B n , X\(B 1 UT 1 U---U T n _i)), 

0„ = ?/>(£?„, X \ (B x U Ti U • • • U T„_ x )). 

By clause (iv) of Lemma 12. 3[ the function 9 n can be described by partitioning 
Pi (B n , X \ (Bi U T\ U • • • U T„_ i ) ) into a countable number of pieces and translating 
each piece by an element of G. Since 9 n is bijective, it follows that fi(T n ) — 
/i(0~ 1 (T„)). Therefore by clause (i) of Lemma 12.31 

fi(T n ) = ii{6-\T n )) = n(Pi(B n , X \ (Bx U T x U • • • U T n _i))) < /i(B„). 

So 

/"(-Bi U Ti U • • • U T n _i) < + m(£?i) + m(S 2 ) + ■ ■ ■ + /i(-Bn-i) < \ 

and hence /x(i? n ) < ± < /x(X \ (Si U Ti U • • • U T„_i)). Applying clause (ii) of 
Lemma I2JJI we find that 



fi(B n \ Px{B n , X \ (Bi U Ti U • • • U T„_i))) = 0. 

Set = S„ \ i\(B n> X \ (Bi U Ti U • • • U T n _i)). 

We now define a new labeling function R : X — > {I, 2, 3, 4} <w by the rule (below 
the symbol denotes concatenation of words and f denotes restriction) 

' L{x) \ [1,(7] if z €Bi 

L(s) — 4 — L^" 1 ^))^ + n) if i G T n and fl-^s) G B n+1 

L(x) — 4 — T^-^aOXC* + ») — 4 if x G T„ and fl~ 1 (x) S„ 

v T(a;) ^ 4 otherwise. 



#(x) 



-l 



Notice that in the second and third cases in the definition of R(x) we automatically 
have 6*~ 1 (x) G B n since x G T n . Clearly |-ff(x)| < C + 3 for every x G X. So the 
image of i? is finite. Let (3 be the partition of X obtained from R, i.e. define the 
classes of (3 so that x, y G X lie in the same class of (3 if and only if R(x) = R(y). 
Then j3 is a finite measurable partition of X. We claim that f3 is a generating 
partition. 

By Lemma |2. II and the definition of /?, we have that (3 is a generating partition 
if and only if there is a set I'CI with fi(X') = 1 such that for every x / i; £ I' 
there is 5 G G with i?(g • x) ^ i?(g • y). Since a is a countable generating partition, 
there is a set X" C X with n(X") — 1 such that for all x ^ y G X" there is g G G 
with a(<7 • x) 7^ a(g ■ y). Set 



X' = X" \ \G ■ U 



n>l 



Then jU(X') = 1. Fix x ^ y E X' . We proceed by cases to show that there is 5 G G 
with JZ( fl • x) ± R(g ■ y). 
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Case 1 : There is n > 1 such that x and y are not i?„-symmetric. Let n > 1 be 
least such that there is u £ G with B n containing precisely one of u ■ x and u ■ y. To 
be specific, say u-x £ B n and u-y B n (the other case is nearly identical). If n — 1 
then the letter 4 appears in R(u ■ y) but not R(u ■ x) and thus R{u ■ x) ^ R(u ■ y). 
So suppose that n > 1. Since n was chosen to be minimal, we must have that x 
and y are B^-symmetric for all k < n. So by clause (iii) of Lemma 12.31 x and y are 
Ti-symmetric. It readily follows from a simple induction argument that x and y are 
both -Bfc-symmetric and Tfc-symmetric for every 1 < k < n. So u ■ x £ B n C B n _i 
implies u ■ y £ B n —\ and clause (v) of Lemma 12.31 implies that there is h £ G with 
& n —i(u ■ x) — hu ■ x and 9 n -i(u ■ y) — hu ■ y (we use here the fact that x, y £ X' 
implies u ■ x,u ■ y ^ E n —\ and thus 6 n -\(u ■ x) and 9 n -\(u ■ y) are defined). Then 
the letter 4 appears once in R(hu ■ x) = R(6 n -\(u ■ xj) (since u ■ x £ B n -i n B n ) 
but appears twice in R(hu ■ y) = R{Q n -\{u ■ y)) (since u ■ y £ B n -\ \ B n ). Thus 
R(hu ■ x) ^ R(hu ■ y). 

Case 2 : For every n > 1 x and y are i3 n -symmetric. Fix u £ G with a(u ■ x) ^ 
a(u ■ y) (such a u exists since x, y £ X' C X"). If u • x is not in B\ then neither is 
u ■ y, and we have that L(u ■ x) and L(u ■ y) are prefixes of R(u ■ x) and R(u ■ y), 
respectively. Thus R(u ■ x) ^ R(u ■ y) if u ■ x B\. So suppose that u- x £ B\. We 
have \L(u ■ x)\ — C + n, where n is maximal with u ■ x £ B n . Since x and y are B^- 
symmetric for every k > 1, we must have |L(n-x)| = \L(u-y)\. Since L(u-x) ^ L{u-y) 
and \L(u-x)\ = \L(u-y)\, there is k > 1 with L(u-x)(k) ^ L(u-y)(k). If k < C then 
from the first case in the definition of R it follows that R(u ■ x)(k) ^ R(u ■ y)(k) and 
thus R(u-x) ^ R(u-y). If k > C then u-x, u-y £ B^^c- Ovrr symmetry assumption 
and clause (v) of Lemma 12.31 imply that there is h £ G with 0fe_c( u ' x ) — hu ■ x 
and Qk-c{ u ■ y) — hu - y (as in Case 1, we again use the fact that u ■ x,u ■ y (jL Ek-c 
since x,y £ X'). Then L(u ■ x)(k) is the letter in R(hu ■ x) which follows the first 
occurrence of 4, and L(u ■ y)(k) is the letter in R(hu ■ y) which follows the first 
occurrence of 4. Therefore R(hu ■ x) ^ R(hu ■ y). □ 

3. Counter-examples for f-invariant and sofic entropies 

In this section we prove Propositions 11.21 and 11.31 We handle f-invariant entropy 
first. 

We remind the reader the definition of an induced action. Let G be a countable 
group and let H < G be a subgroup of finite index. Let G/H denote the set of left 
ii-cosets {gH : g £ G}, and let C be the uniform probability measure on G/H. We 
let G act on (G/H, £) by defining g ■ (aH) = gaH. Fix any function a : G/H — > G 
with a(H) = 1g and <j(gH) £ gH for all g £ G. We abuse notation and let a(g) 
denote <j(gH) for g £ G. Let 7 : (G/H) x G — > H be the cocycle defined by 

j(aH, g) = ^(gay 1 ■ g ■ a (a). 

If H acts by measure preserving bijections on a probability space (Y, v), then we 
define a measure preserving action of G on the probability space ((G/H) x Y, ( x v) 

by 

g ■ (aH, y) = (gaH, j(aH, g) ■ y). 

One can check that this is a well defined action of G. It is called the action of G 
induced from H rx (Y, v). It is well known that the induced action of G is ergodic 
if and only if H rx (Y, v) is ergodic [19] . 



10 



BRANDON SEWARD 



Proposition 3.1. Let G be a finitely generated non-cyclic free group. For every 
h e M, 

sup Aq(X,h)= sup A G (X, fji) = +oc, 

Grv(X,^) Gr\(X,n) 

where the supremums are taken over all essentially free ergodic probability measure 
preserving actions G rx (X,fi) with f G (X,/i) defined and f G (X,fi) = h. 

Proof. We will use the notations and definitions of [TB]. Fix a finitely generated 
non-cyclic free group G, fix h € R, and let M > 0. We will construct an essentially 
free ergodic action G rx (X,n) such that f G (X,fi) is defined, f G (X,ii) = h, and 
log(A G (X,fx))>A* G (X,fx)>M. 

Let r > 1 be the rank of G. Fix n > exp( ^f^ ). Let ^ be a probability measure 
on N satisfying 

H(i/) = ~ v (k) ■ \og(v(k)) = n ■ h + n(r — 1) • log(n). 

fcSN 

Notice that the right hand side is positive since n > exp(-^j-) and thus such a 
probability measure v exists. Let if be a normal subgroup of G with \G : K\ = n. 
Consider the Bernoulli shift K rx (N K ,u K ). By [Tj we have that f K (N K , v K ) is 
defined and 

f K (N K , v K ) = H(i/) = n-h + n{r-l)- log(n). 
Let £ be the uniform probability measure on G/K, set (X, /1) = ((G/K) x N K , £ x 
f ), and let G rx (X,[i) be the action of G induced from K rx (N K , v K ). Since 
K rx (N , v ) is ergodic, G rx (X, fi) is ergodic as well. It is easy to see that K rx 
(X, fi) has n ergodic components, namely {gK} x N K for gK € G/K, and the action 
of K on any of its ergodic components is measurably conjugate to K rx (N K , v K ). 
The sets {(aK,y) G (G/K) x E K : aK = gK, y(l K ) = t} for gK € G/K and 
tgN form a generating partition for K rx (X, ji) , and it is readily checked that this 
partition has Shannon entropy H(^) + log(n) < 00. Therefore fx(X, /i) is defined. 
The rank of K , rK, is related to its index, n, by the formula rx = n ■ (r — 1) + 1 
[Proposition 1.3.9 [H]]. So by the ergodic decomposition formula [TB] 

f K (X, /i) = f K (N K , v K ) - (r K - 1) log(n) - f K (N K , v K ) - n(r - 1) log(n) = n • h. 

Now by the subgroup formula |15) we have 

f G (X, t i) = --f K (X,^) = h. 
n 

Since /z has no atoms, it follows from the main theorem of [16) that G rx (X, /i) is 
essentially free. 

Now suppose that a is a generating partition for G rx (X,fi) with H(a) < 00. 
Fix <7i, <72j • • • j 9n S G with g\ = and G / K = {giK : 1 < i < n). Enumerate the 
if -ergodic measures in the support of /x as /12, • ■ • , /U„ so that fii({giK}xN K ) = 1 
for each 1 < i < n. Notice that fix — gf x ■ fa. By p~6l Lemma 4.2 (ii)] we have 

1 - 

-•^H w (a)<H M (a). 

i=i 

Let /3 be the restriction of VILi 5^ 4 a to {^1 x Then 

n n 

H m 08) < £ H Ml (g- 1 •a)=Y, ^ (a) < n • H(a). 

t=i i=i 
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Since K is normal we have 

G ■ a = K ■ {.gi,32, ...,g n }-a 

and hence (3 is a generating partition for K rv ({^} X N , /^i). It follows that 
f K ({K} x < H Ml (/3) [I]. However, if rv ({if} x is measurably 

conjugate to if rv (N , f^) and therefore 

n ■ h + n(r - 1) • log(n) = /k(N k , - MW x N x , /xi) < H Ml (/9) < n • H(o). 

Since a was an arbitrary finite Shannon entropy generating partition for G rv (X, /i) 
it follows that 

A* G (X, n)>h + (r-l)- log(n) > M. 
Finally, we of course always have the inequality log(Acj(Jf, fi)) > A G (X, /i). □ 

We point out that the action G rv (X, fi) constructed in the above proof factors 
onto G rv (G/K, () which has f-invariant entropy f G (G/K, £) = — (r— l)dog(n) < 
( [TBI Lemma 2.3]). We do not know if the above proposition is still true if in 
addition to picking h € R one picks a constant c > and considers essentially free 
ergodic actions G rv (X, fi) which not only satisfy fa (X, /i) = h but also satisfy 
/g(V, i/) > — c for every factor (Y, v) of (X,fi). This additional requirement could 
potentially lead to a result similar to Krieger's finite generator theorem. 

Now we consider the case of sofic entropy. 

Lemma 3.2. There is a sofic group G, a sofic approximation sequence X to G, 
and a normal subgroup K <\G of finite index such that h^{G/K,(^) = — oo ; where 
C, is the uniform probability measure on G/K . 

Proof. For the sake of brevity we give a simple example of such a group. However 
the situation described in the lemma should occur whenever G has a subgroup of 
finite index and admits a sofic approximation sequence coming from a sequence of 
expander graphs. 

We will use some of the notation and definitions from [3]. Let G be a finitely 
generated non-cyclic free group. It is well known that such groups are sofic. Fix a 
normal subgroup K of G of index 2. Let Q be the uniform probability measure on 
G/K. By |16[ Lemma 2.3], the f-invariant entropy of this action is 

/ G (G//f,C) = -(r-l)-log(2)<0, 

where r > 1 is the rank of G. Let <f> : G/K — ) {0,1} be a bijection. In [3], 
Bowen proved that f-invariant entropy can be obtained by considering random 
homomorphisms into finite symmetric groups and then performing computations 
similar to those used in defining sofic entropy. In particular, his theorem implies 
that we can find a sofic approximation sequence S = {oj : i £ N} to G consisting 
of homomorphisms <7j : G — > Sym(mi) such that 

|V: {1,2,...,™,}^ {0,1} : <e}| =0 

for sufficiently small e > 0, sufficiently large finite sets H C G, and sufficiently large 
i£N. Using the definition of sofic entropy given in [2], it immediately follows from 
the previous sentence that h^{G/K,Q = — oo. □ 

Proposition 3.3. There exists a sofic group G, a sofic approximation sequence E 
to G, and an essentially free ergodic action G rv (X, /i) such that ti^{X,n) = — oo 
but A* G {X, fx) = A G (X, n) = +oo. 
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Proof. Take any sofic group G and sofic approximation sequence X to G with 
the properties that there is a normal subgroup K <\ G of finite index such that 
h^(G/K, Q — — oo, where £ is the uniform probability measure on G/K. Consider 
the Bernoulli shift K rx ([0, 1]^, A^), where A is Lebesgue measure on the interval 
[0,1]. Let G rx (X,fi) be the induced action of G, where X = (G/K) x [0,1] K 
and /j = (x \ K . Since K rx ([0, 1] K , \ K ) is ergodic, so is G rx (X, /i). If g e G 
has a non-trivial power g n lying in K, then the set of points in X fixed by g must 
have measure since the action of K is essentially free. On the other hand, if g 
has no non-trivial power lying in K, then g acts freely on G/K (since K is normal) 
and thus acts freely on X. So the action G rx (X,/j,) is essentially free. Clearly 
G rx (X,[i) factors onto G rx (G/K,C/). Let £ be the finite partition of X associ- 
ated to this factor map. Using Kerr's definition of sofic entropy [7J, we can work 
with partitions finer than £ and use the fact that h^(G/K,C/) = — oo to quickly 
obtain h^k(X, /i) — — oo. As was shown in the proof of the previous corollary, any 
finite Shannon entropy generator for G rx (X, fi) would provide a finite Shannon 
entropy generator for K rx ([OjlJ^A^) (see the role of a and (3 in that proof). 
However, Kerr and Li [9] proved that K rx ([0, 1]^, X K ) does not admit any gener- 
ating partition having finite Shannon entropy (we use here the fact that a subgroup 
of a sofic group is sofic [H]). Thus AJ,(X, ft) = A G (X, ft) — +oo. □ 

It is unknown to the author if Krieger's theorem and Rohlin's theorem hold 
for actions of sofic groups for which the sofic entropy is not negative infinity. We 
mention that the potential dependence of sofic entropy on the choice of a sofic 
approximation sequence clearly poses a potential obstruction to Rohlin's theorem. 
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